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ABSTRACT 

A  four-dimensional  variational  data  assimilation  (4DVAR)  system  was  recently  developed  for  the  Navy 
Coastal  Ocean  Model  (NCOM).  The  system  was  tested  in  the  first  part  of  this  study  using  synthetic  surface  and 
subsurface  data.  Here,  a  full  range  of  real  surface  and  subsurface  data  is  considered  following  encouraging 
results  from  the  preliminary  test.  The  data  include  sea  surface  temperature  and  sea  surface  height  from 
satellite,  as  well  as  subsurface  observations  from  gliders  deployed  during  the  second  Autonomous  Ocean 
Sampling  Network  field  experiment  in  California’s  Monterey  Bay.  Data  assimilation  is  carried  out  with  strong 
and  weak  constraints,  and  results  are  compared  against  independent  observations.  This  study  clearly  shows 
that  the  4DVAR  approach  improves  the  free-running  model  simulation  and  that  the  weak  constraint  ex¬ 
periment  has  lower  analysis  errors  than  does  the  strong  constraint  version. 


1.  Introduction 

Following  up  on  promising  results  in  Ngodock  and 
Carrier  (2014,  hereafter  Part  I)  from  the  assimilation 
of  synthetic  observations  in  the  Monterey  Bay  of  Cal¬ 
ifornia  using  a  four-dimensional  variational  data  as¬ 
similation  (4DVAR)  system  developed  for  the  Navy 
Coastal  Ocean  Model  (NCOM),  consideration  is  now 
given  to  real  observations.  The  assimilation  of  synthetic 
observations  was  intended  to  test  the  functionality  of  the 
4DVAR  system  and  its  ability  to  fit  the  observations  and 
correct  erroneous  external  forcing  fields.  The  system  is 
used  here  to  assimilate  observations  from  the  second 
Autonomous  Ocean  Sampling  Network  (AOSN  II),  an 
oceanographic  data  campaign  that  took  place  in  Mon¬ 
terey  Bay  from  23  July  to  6  September  2003  and  that 
was  supported  by  a  nowcast  effort  from  three  model¬ 
ing  groups:  the  Harvard  Ocean  Prediction  System 
(HOPS;  Robinson  et  al.  1996;  Robinson  1999;  Haley 
et  al.  1999),  the  Regional  Oceanic  Modeling  System 
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(ROMS;  Shchepetkin  and  McWilliams  2005),  and 
NCOM  (Martin  2000;  Barron  et  al.  2004,  2006). 

Monterey  Bay  is  an  interesting  region  for  ocean 
modeling  due  to  a  complex  coastline  with  steep  topog¬ 
raphy,  strong  land-sea-breeze  patterns,  and  the  exis¬ 
tence  of  frequent  local  upwelling  and  relaxation  events 
(Shulman  et  al.  2002).  The  region  is  also  home  to  regu¬ 
lar  observation  campaigns.  According  to  Ramp  et  al. 
(2009),  other  factors  making  Monterey  Bay  an  ideal 
location  for  such  an  experiment  as  AOSN  II  are  its  close 
proximity  to  several  large  research  institutions;  ship 
availability;  the  wealth  of  environmental  and  scientific 
problems  presented;  the  wide  continental  shelves  within 
and  to  the  north  of  the  bay  providing  a  strong  contrast  to 
the  nearby  deep  water  within  the  Monterey  Bay  Sub¬ 
marine  Canyon  (MSC)  and  the  narrower,  steeper  shelf 
to  the  south;  and  finally  the  two  upwelling  centers  at 
Point  Sur  and  Cape  Ano  Nuevo,  which  are  both  within 
a  day’s  steam  by  research  vessel. 

The  real-time  analysis  and  forecast  support  of  the 
AOSN  II  field  experiment  was  followed  by  reanalysis 
data  experiments  by  several  authors  (Haley  et  al.  2009; 
Chao  et  al.  2009;  Shulman  et  al.  2009).  The  general 
conclusion  from  these  experiments  is  that  the  reanalysis 
was  in  better  agreement  with  both  the  assimilated  and 
independent  temperature  and  salinity  observations  after 
some  model  parameters  were  adjusted.  The  same  fit  was 
worse  in  the  real-time  support  of  the  field  experiment. 
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Fig.  1.  (a)  All  gliders  and  the  two  mooring  positions,  and  assimilated  (b)  Slocum  and  (c)  Spray  glider  tracks  during  August  2003.  The  red 
dots  represent  the  locations  of  the  moored  buoys  Ml  (inside  the  bay)  and  M2  (offshore),  and  the  red  box  represents  the  Ano  Nuevo 
upwelling  center. 


Also,  the  surface  velocity  field  derived  from  the  re¬ 
analysis  could  only  qualitatively  resemble  the  one  ob¬ 
served  by  HF  radar  stations,  with  the  amplitude  and 
position  of  current  features  sometimes  found  to  be  er¬ 
roneous  (Haley  et  al.  2009;  Chao  et  al.  2009). 

It  is  worth  noting  that  in  both  real  time  and  reanalyses 
with  the  AOSN  II  dataset  all  the  experiments  used 
a  sequential  data  assimilation  technique:  the  error  sub¬ 
space  statistical  estimation  of  Lermusiaux  et  al.  (2002), 
the  three-dimensional  variational  data  assimilation 
(3DVAR)  scheme  (Chao  et  al.  2009),  or  the  multivariate 
optimal  interpolation  of  Cummings  (2005)  used  in 
Shulman  et  al.  (2009,  2010).  None  was  carried  out  with 
a  4DVAR-type  scheme.  In  this  study,  the  same  dataset 
will  be  assimilated  using  the  4DVAR  algorithm  based 
on  the  representer  method  that  was  developed  for  the 
Navy  Coastal  Ocean  Model.  Of  particular  interest  is  the 
ability  of  the  4DVAR  system  to  overcome  the  short¬ 
comings  of  the  sequential  methods  through  its  ability  to 
fit  the  observations  without  adjusting  the  model  pa¬ 
rameters.  The  4DVAR  system  will  seek  to  adjust  either 
the  initial  conditions  (strong  constraints)  or  the  model 
forcing  (weak  constraints),  or  both,  by  exploiting  flow- 
dependent  correlations  defined  by  the  integration  of  the 
adjoint  and  tangent  linear  models. 

Coastal  upwelling  and  relaxation,  as  well  as  the  me- 
soscale  variability  were  the  main  physical  processes  of 
interest  for  the  observation  campaign.  Upwelling  and 
relaxation  events  play  a  major  role  in  the  ocean  dy¬ 
namics  in  and  around  Monterey  Bay.  Upwelling  is  the 
ocean’s  response  to  northwesterly  winds,  and  relaxation 
occurs  as  the  winds  weaken  and/or  change  direction. 
These  upwelling  and  relaxation  events  occur  mainly 
around  two  so-called  upwelling  centers:  Ano  Nuevo  to 
the  northwest  of  the  bay  and  around  Point  Sur  to  the 


south  of  the  bay.  Surface  wind  observations  at  the 
Monterey  Bay  Aquarium  Research  Institute  moorings 
Ml  and  M2  during  August  2003  show  that  upwelling- 
favorable  winds  prevailed  from  7  to  19  August,  followed 
by  relaxation-favorable  winds  from  20  to  25  August, 
when  upwelling-favorable  winds  returned  (Shulman 
et  al.  2010).  The  locations  of  the  Ml  and  M2  buoys  are 
shown  in  Fig.  1,  along  with  glider  tracks.  Several  Slocum 
and  Spray  gliders  sampled  the  Ano  Nuevo  upwelling 
center  during  the  transitions  from  upwelling  to  re¬ 
laxation  and  back  to  upwelling,  providing  observations 
that  allow  the  assessment  of  the  model  and  assimilation 
performance  during  those  events. 

A  time  series  of  observed  and  modeled  wind  barbs  at 
Ml  and  M2  is  shown  in  Fig.  2,  along  with  the  observed 
and  modeled  SST.  It  can  be  seen  in  Fig.  2  that  upwelling 
is  associated  with  the  decrease  in  surface  temperature 
following  northwesterly  winds.  Relaxation  follows  when 
the  wind  pattern  is  altered  or  reversed  and  is  associated 
with  the  rise  of  surface  temperature.  The  correlation 
between  the  wind  and  surface  temperature  patterns 
seems  to  be  stronger  at  Ml  than  at  M2.  The  wind  di¬ 
rection  suggests  that  the  upwelled  waters  around  Ano 
Nuevo  are  flowing  toward  Ml.  Therefore,  the  assimila¬ 
tion  solutions  will  be  evaluated  at  Ml  to  ensure  that  the 
prevalent  dynamics  of  the  region  are  preserved  by  the 
assimilation  system;  that  is,  the  fit  to  the  observations  is 
not  accomplished  at  the  expense  of  the  dynamics.  Both 
wind  direction  and  temperature  patterns  observed  at  Ml 
show  that  there  is  an  upwelling  event  from  5  to  15  August, 
as  well  as  a  relaxation  event  from  15  to  23  August.  From 
23  to  25  August  there  is  a  short-lived  upwelling  fol¬ 
lowed  by  a  short-lived  relaxation,  and  from  25  August 
to  the  end  of  the  assimilation  window  there  is  only  an 
upwelling  event. 


2110 


MONTHLY  WEATHER  REVIEW 


Volume  142 


r|  Wind  Stress  at  Ml  (N/rrf ) 


Wind  Stress  at  M2  (N/rrf) 


- - 

flj  N/m2 


10  20  30 

d  SST  at  M2  Buoy 


U 

9 

~0 


H 

00 

00 


10  20  30 

Days  Past  August  1,  2003 


10  20  30 

Days  Past  August  1.  2003 


Fig.  2.  Observed  (black)  and  modeled  (red)  (a),(b)  wind  barbs  at  the  Ml  and  M2  buoy  locations 
and  (c),(d)  surface  temperature. 


It  was  suggested  in  Part  I  of  this  study  that  the  as¬ 
similation  system  was  able  to  fit  the  observations  with 
low  prescribed  model  errors  while  the  free  run  had 
relatively  high  errors  prescribed  to  the  model  forcing 
fields.  The  study  here  aims  to  demonstrate  the  robustness 
of  the  assimilation  system  in  its  ability  to  accurately 
fit  assimilated  and  nonassimilated  real  observations 
and  dynamics  of  Monterey  Bay  with  low  model  errors 
as  well. 

Brief  descriptions  of  the  dataset  and  the  assimilation 
system  are  given  in  sections  2  and  3,  respectively,  fol¬ 
lowed  by  the  assimilation  experiment  results  in  section 
4.  Concluding  remarks  are  given  in  section  5. 

2.  Data 

The  dataset  used  in  this  study  consists  of  SST  from 
satellite  and  aircraft,  a  few  sea  surface  heights  (SSHs) 
from  satellite  altimetry  (due  to  the  limited  area  of 
the  model  domain),  vertical  profiles  of  temperature  and 
salinity  from  Slocum  and  Spray  gliders  and  two  moor¬ 
ings  (Ml  and  M2),  and  AXBTs.  All  the  vertical  profiles 
are  projected  onto  a  static  grid  of  50  levels.  The  ob¬ 
servations  are  obtained  through  the  operational  Navy 
Coupled  Ocean  Data  Assimilation  (NCODA)  system  by 


Cummings  (2005),  which  also  contains  a  data  acquisition 
and  quality  control  component.  The  SSH  observations 
are  not  assimilated  because  only  a  few  distant  observa¬ 
tions  appear  sporadically  in  the  domain  every  2-3  days. 
On  the  other  hand,  the  majority  of  the  SST  observations 
are  from  the  Geostationary  Operational  Environmental 
Satellite  (GOES)  series,  with  a  spatial  resolution  of 
about  6  km  in  the  absence  of  cloud  cover. 

Slocum  glider  tracks  covered  a  portion  of  the  bay,  the 
mouth  of  the  bay,  and  the  area  to  the  northwest  of  the 
bay  (i.e.,  the  upwelling  center  around  Ano  Nuevo). 
Spray  glider  tracks  originated  from  the  nearshore  and 
went  offshore  in  transectlike  trajectories,  as  seen  in  Fig.  1. 
As  a  result  of  the  sampling  frequency  of  the  gliders, 
many  observations  are  adjacent  to  each  other  along 
glider  tracks.  To  avoid  redundancy,  some  of  the  glider 
data  are  withheld  from  the  assimilation  and  are  used  for 
validation  of  the  analyses,  as  is  also  the  case  for  the 
mooring  Ml.  Withholding  the  data  takes  into  account 
the  model  grid  resolution  and  the  prescribed  horizontal 
and  temporal  decorrelation  scale  of  the  model  error  in 
such  a  way  that  only  one  data  point  is  retained  within 
one-and-a-half  decorrelation  scale  at  any  given  time. 
The  observations  are  assigned  a  constant  error  of  0.4  K 
and  0.1  psu  in  temperature  and  salinity,  respectively. 
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3.  Experiments  and  results 

The  4DVAR  assimilation  system  was  described  in 
Part  I.  It  has  the  flexibility  to  carry  out  experiments  with 
either  strong  constraints  using  a  gradient  descent  ap¬ 
proach  or  weak  constraints  using  the  indirect  repre¬ 
senter  method  (Bennett  1992,  2002).  Smaller  error 
variances  and  shorter  spatial  (30  km)  and  longer  tem¬ 
poral  (3  days)  decorrelation  scales  are  adopted  for  the 
assimilation  of  the  AOSN  II  data. 

The  assimilation  covers  the  time  window  from  1  to 
31  August  2003,  and  is  carried  out  in  cycles  of  5  days, 
with  the  analysis  at  the  end  of  a  cycle  becoming  the 
initial  conditions  for  the  following  cycle.  Observations 
are  processed  and  stored  in  6-h  intervals,  and  the 
4DVAR  system  assimilates  all  observations  within  each 
5-day  cycle.  The  performance  of  the  assimilation  system 
is  examined  by  computing  the  difference  between  the 
observations  and  three  model  solutions:  (i)  the  free- 
running  (nonassimilative)  model  that  is  integrated  from 
the  given  initial  conditions  and  forcing  fields;  (ii)  the  first 
guess  (also  nonassimilative),  for  which  the  initial  con¬ 
ditions  are  updated  from  the  assimilation  in  the  previous 
cycle,  with  the  exception  of  the  first  cycle  where  both  the 
first  guess  and  the  free-running  model  are  equal;  and 
(iii)  the  analysis.  The  first  guess  (not  shown)  is  also  the 
background  trajectory  for  the  tangent  linear  model  and 
the  adjoint  (i.e.,  the  trajectory  around  which  the  model  is 
linearized).  It  is  stored  in  intervals  of  6h.  It  is  expected 
of  every  assimilation  system  to  fit  the  assimilated  ob¬ 
servations  within  one  observation  standard  deviation. 
Unassimilated  observations  consist  of  withheld  obser¬ 
vations  within  the  current  assimilation  window  and  fu¬ 
ture  observations,  that  is,  those  in  the  next  cycle  before 
the  assimilation.  The  assimilation  is  expected  to  fit  the 
former  as  a  measure  of  the  system’s  ability  to  propagate 
the  information  from  the  assimilated  observations  sites 
through  the  model’s  space-time  domain  within  the  as¬ 
similation  window.  However,  there  is  no  expectation  to 
fit  future  observations;  that  is,  the  innovations  in  the 
next  cycle  are  not  expected  to  be  smaller  than  the  ob¬ 
servation  standard  deviation.  One  only  hopes  that  hav¬ 
ing  initialized  the  model  from  the  previous  cycle’s 
assimilation,  the  model  forecast  will  remain  sufficiently 
accurate  to  maintain  small  innovations,  given  an  accu¬ 
rate  external  forcing. 

There  are  two  assimilation  experiments  presented  in 
this  work.  First,  a  strong  constraint  4DVAR  experiment 
is  set  up  on  the  assumption  that  the  discrepancy  between 
the  model  and  the  observations  is  solely  due  to  erroneous 
initial  conditions.  This  is  done  in  part  because  it  was  re¬ 
ported  by  Haley  et  al.  (2009)  that  the  atmospheric  forc¬ 
ing  fields  provided  by  the  Coupled  Ocean-Atmosphere 


Mesoscale  Prediction  System  (CO AMPS)  were  mostly 
in  agreement  with  local  independent  observations.  The 
strong  constraint  is  achieved  by  setting  the  model  error 
to  zero  in  the  representer  algorithm.  Thus,  the  initial 
increments  are  propagated  forward  in  time  using  line¬ 
arized  dynamics.  Because  the  assimilation  window  is 
within  the  time  range  of  validity  of  the  tangent  linear 
approximation,  this  approach  is  expected  to  yield  similar 
results  to  the  traditional  strong  constraints  where  the 
initial  condition  increments  are  propagated  through  the 
nonlinear  model.  The  second  experiment  is  the  weak 
constraint  assimilation  using  the  representer  algorithm, 
with  model  errors  prescribed  in  addition  to  the  initial 
condition  errors.  Although  the  CO  AMPS  wind  forcing 
field  is  in  good  agreement  with  local  buoys,  it  can  have 
errors  of  about  2 ms-1,  that  is,  100%  of  the  wind  stress, 
according  to  Kindle  et  al.  (2002)  and  Haley  et  al.  (2009). 
In  addition,  Shulman  et  al.  (2009)  suggested  that  the 
daily  average  atmospheric  solar  heat  flux  can  be  in 
error  by  as  much  as  29-36  W  m~2  and  that  on  any  given 
day  the  error  may  be  much  higher,  between  50  and 
90Wm”2,  which  is  roughly  12%-20%  of  the  total  heat 
flux.  Initial  condition  errors  for  temperature,  salinity, 
velocity,  and  SSH  are  2K,  0.5 psu,  0.52 ms-1,  and  0.1m, 
respectively.  The  model  errors  in  the  assimilation  system 
are  20%  of  the  heat  flux,  5%  of  the  salinity  flux,  and  5% 
of  the  wind  stress. 

a.  Fitting  the  assimilated  observations 

Assimilation  results  are  shown  for  the  upper  200  m, 
which  seems  to  be  the  active  layer  according  to  Liang 
and  Robinson  (2009).  The  differences  between  the  ob¬ 
servations  and  the  model  are  computed  for  all  assimi¬ 
lated  profiles  of  temperature  and  salinity  and  plotted 
in  chronological  order  in  Fig.  3.  It  can  be  seen  that 
the  temperature  differences  are  confined  in  the  upper 
100  m  of  the  water  column,  with  magnitudes  sometimes 
reaching  3  K  for  the  free  run.  Salinity  differences  extend 
deeper  in  the  water  column,  to  about  200  m,  although 
the  largest  differences  are  also  confined  to  the  upper 
100  m.  The  assimilation  is  able  to  significantly  reduce  the 
free-run  discrepancies  in  both  the  temperature  and  sa¬ 
linity  fields,  with  the  exception  of  a  few  profiles.  The 
assimilation  is  able  to  reduce  discrepancies  as  high  as  3  K 
and  0.4  psu  to  less  than  0.5  K  and  0.1  psu  in  temperature 
and  salinity,  respectively.  There  are  only  a  few  notice¬ 
able  differences  between  the  strong  and  weak  constraint 
analysis  residuals;  they  both  fit  the  assimilated  glider 
data  with  similar  accuracy. 

b.  Upwelling  center 

The  Ano  Nuevo  upwelling  center  was  sampled  al¬ 
most  exclusively  by  the  Slocum  gliders.  The  ability  of  the 
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Fig.  3.  Absolute  model  (left)  temperature  and  (right)  salinity  discrepancies  compared  to  assimilated  observations 
for  (a),(b)  the  free  run,  and  the  (c),(d)  strong  and  (e),(f)  weak  constraint  analyses.  The  residuals  are  computed  for  all 
assimilated  glider  data. 


assimilation  system  to  correct  the  model  deficiencies  in 
simulating  the  upwelling  and  relaxation  events  is  as¬ 
sessed  by  examining  the  analysis  residuals  for  the  Slo¬ 
cum  gliders  only. 

It  can  be  seen  in  Fig.  4  that  temperature  discrepancies 
from  the  free  run  were  moderate  during  the  first  up- 
welling  and  relaxation  events  (i.e.,  20  August).  Tem¬ 
perature  discrepancies  increased  from  the  end  of  the 
relaxation  event  through  the  short-lived  upwelling  and 
relaxation  events  between  22  and  25  August,  as  men¬ 
tioned  earlier,  and  the  discrepancies  kept  growing  until 
the  end  of  the  assimilation  window.  The  salinity  dis¬ 
crepancies  are  rather  low  throughout  the  assimilation 
window,  with  only  a  few  noticeable  profiles  where  the 


free  run  departs  from  the  observations  by  0.4  psu.  The 
strong  constraint  assimilation  fits  most  of  the  Slocum 
temperature  and  salinity  profiles  remarkably  well.  Only 
a  few  isolated  profiles  (e.g.,  temperature  during  the 
short-lived  upwelling  and  relaxation  events  around 
25  August,  and  salinity  profiles  around  13  and  22  August) 
have  analysis  residuals  greater  than  the  observation 
standard  deviation.  Most  of  these  residuals  are  further 
reduced  in  the  weak  constraint  assimilation,  with  the 
exception  of  the  salinity  profile  around  13  August.  Thus, 
the  assimilation  system  is  able  to  correct  the  model  tra¬ 
jectory  so  that  it  fits  the  observations  of  the  upwelling  and 
relaxation  events  in  both  the  strong  and  weak  constraint 
experiments. 
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Fig.  4.  As  in  Fig.  3,  but  for  Slocum  gliders  only. 
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Fig.  5.  As  in  Fig.  3,  but  for  nonassimilated  Slocum  glider  observations. 


c.  Independent  observations 

For  verification  and  evaluation  purposes,  discrep¬ 
ancies  are  computed  between  the  withheld  glider  ob¬ 
servations  and  the  three  model  solutions:  the  free  run, 
and  the  strong  and  the  weak  constraint  analyses.  Results 
are  shown  in  Fig.  5  for  the  withheld  Slocum  glider  data 
for  the  main  reason  that  these  are  the  gliders  that  mostly 
sampled  the  upwelling  center  of  Ano  Nuevo.  It  can  be 
seen  that  both  strong  and  weak  constraint  analyses 
generally  fit  these  nonassimilated  observations  with  the 
same  level  of  accuracy.  This  result  was  expected  because 
in  most  cases  the  withheld  observations  were  located  in 
the  vicinity  of  assimilated  observations. 

In  addition  to  the  withheld  glider  observations,  the 
model  solutions  were  also  compared  to  the  unassimilated 


observations  collected  at  the  Ml  and  M2  moored  buoys, 
with  results  shown  in  Fig.  6  for  Ml. 

At  the  Ml  buoy  the  free-run  solution  has  moderate  to 
high  temperature  discrepancies  from  the  beginning  of 
the  assimilation  window  to  the  onset  of  the  three  rapid 
transitions  from  relaxation  to  upwelling  to  relaxation  and 
to  another  upwelling  event  between  22  and  25  August. 
These  discrepancies  grow  subsequently  as  evidence  of 
the  model  diverging  from  the  independent  observations, 
as  was  the  case  along  the  Slocum  glider  tracks.  The 
temperature  discrepancies  of  the  analyses  show  that  both 
the  strong  and  weak  constraint  assimilations  are  able  to 
accurately  reproduce  the  observed  temperatures  at  Ml. 

In  stark  contrast  with  temperature,  salinity  discrep¬ 
ancies  from  the  free  run  show  that  the  model  salinity  be¬ 
gins  to  diverge  from  the  independent  observations  2  days 
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Fig.  6.  As  in  Fig.  5,  but  for  buoy  Ml. 
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salinity  observations  for  the  free  run  (black),  and  the  strong  (blue)  and  weak  (red)  constraint  analyses. 


into  the  assimilation  window  with  growing  errors  until 
23  August,  right  before  the  rapid  transitions  mentioned 
above.  In  addition,  the  salinity  discrepancies  extend 
deeper  into  the  water  column.  The  analysis  discrep¬ 
ancies  show  that  the  strong  constraint  assimilation  was 
able  to  significantly  but  not  completely  reduce  the  er¬ 
rors,  particularly  the  peak  salinity  errors  around  14  and 
19-21  August.  Although  some  discrepancies  still  linger 
in  the  weak  constraints  analysis  (e.g.,  days  5  and  8  near 
the  surface),  it  shows  a  further  reduction  in  the  errors: 
the  peak  errors  around  14  August  have  disappeared  and 
those  around  19-21  August  are  significantly  reduced  in 
size  and  magnitude. 

4.  Fit  metric 

A  global  measure  of  the  fit  to  the  observations  is 
given  by 


'FIT 


1  §  lyw-gw*fll 

^  m= 1  am 


(1) 


where  Mis  the  total  number  of  assimilated  observations, 
ym  is  the  rath  observation,  Xa  is  the  analysis  trajectory, 
Hm  is  the  observation  operator  associated  with  ym,  and 
crm  is  the  observation  standard  deviation.  Because  the 
assimilation  is  expected  to  fit  the  observations  to  within 
their  prescribed  standard  deviation,  /FIT  is  expected  to 


be  less  than  1  for  each  assimilation  cycle.  The  analysis 
trajectory  in  (1)  can  be  replaced  by  the  free-run  trajec¬ 
tory  in  order  to  assess  the  latter’s  accuracy  (i.e.,  how 
close  the  free  run  is  to  the  observations  before  assimi¬ 
lation).  Since  the  observations  are  binned  in  time  in¬ 
crements  of  6h,  /FIT  can  be  computed  over  time  to 
examine  the  evolution  of  the  fit  to  the  observations  by 
the  analysis  and  the  free  run.  Results  in  Fig.  7  show  that 
the  weak  constraint  analysis  generally  fits  the  assimi¬ 
lated  temperature  and  salinity  observations  to  within 
a  standard  deviation.  The  strong  constraints  also  fit  the 
assimilated  observations  to  within  a  standard  deviation, 
but  only  initially.  As  time  progresses,  the  fit  becomes 
less  accurate,  mostly  for  temperature.  This  less  accurate 
fit  from  the  strong  constraints  could  be  the  result  of 
fewer  degrees  of  freedom  (compared  to  the  weak  con¬ 
straints)  and  the  presence  of  frequent  relaxation  and  an 
upwelling  event  in  the  second  half  of  the  assimilation 
window.  The  fit  to  the  assimilated  salinity  observations 
is  similar  in  both  the  weak  and  strong  constraint  experi¬ 
ments  throughout  the  assimilation  window,  generally 
within  one  standard  deviation,  except  for  during  the 
periods  11-13,  17,  and  22-23  August. 

As  for  the  independent  observations,  the  fit  to  tem¬ 
perature  is  within  a  standard  deviation  from  the  begin¬ 
ning  of  the  assimilation  window  to  about  10  August, 
for  both  strong  and  weak  constraint  experiments.  The 
temperature  metric  values  then  start  to  slowly  deviate 
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Fig.  8.  Absolute  temperature  discrepancies  from  nonassimilated  observations  for  (a)  the 
original  and  (b)  the  longer  correlations  weak  constraint  assimilation  experiments. 


from  the  target  value  of  one  until  18  August,  when  they 
reach  1.3  and  1.6  standard  deviations  for  the  weak  and 
strong  constraints,  respectively.  From  18  to  30  August 
the  fit  tends  to  grow,  reaching  1.9  (1.7)  standard  devi¬ 
ations  on  29  (25)  August  for  the  strong  (weak)  constraints. 
The  fit  metric  for  nonassimilated  salinity  observations 
is  similar  for  both  strong  and  weak  constraint  solutions, 
and  is  almost  always  greater  than  the  target  value  of  one, 
occasionally  peaking  at  about  1.6. 

The  less  accurate  fit  to  nonassimilated  observations 
seems  to  contradict  the  accurate  fit  to  the  assimilated 
observations  and  the  expectation  that  the  assimilation 
should  also  fit  independent  observations  located  away 
from  the  assimilated  ones.  One  should  keep  in  mind  that 
the  assimilated  observations  were  specifically  selected  in 
such  a  way  that  only  one  observation  was  retained  within 
each  time-space  decorrelation  scale.  Given  the  moder¬ 
ate  flow  in  the  model  domain,  it  can  be  argued  that  the  fit 
to  nonassimilated  observations  is  less  accurate  because 
the  information  spreads  slowly  from  the  observation 
locations  to  other  parts  of  the  domain,  an  outcome  that 
can  be  reversed  either  by  selecting  more  observations  to 
be  assimilated  or  longer  decorrelation  scales.  This  hy¬ 
pothesis  was  examined  by  carrying  out  a  weak  constraint 
experiment  with  a  spatial  decorrelation  scale  of  50  km 
instead  of  30  km,  while  the  observations,  initial  conditions, 
and  model  error  standard  deviations  are  unchanged. 
Temperature  analysis  errors  for  nonassimilated  obser¬ 
vations  were  compared  to  the  corresponding  errors  from 
the  original  weak  constraint  experiment.  It  is  shown  in 
Fig.  8  that  marginal  improvements  in  the  analysis  error 
with  the  longer  scales  were  obtained.  It  is  arguable  that 
further  reduction  of  these  discrepancies  could  have  been 
achieved  with  even  longer  correlation  scales  or  higher 
initial  conditions  and  model  errors.  However,  both  the 
correlation  scales  and  the  error  levels  cannot  be  adjusted 


arbitrarily  for  the  sole  purpose  of  fitting  observations. 
They  also  have  to  be  rigorously  assessed  and  validated. 
Such  an  effort  is  beyond  the  scope  of  this  study. 

The  assimilation  system’s  ability  to  fit  the  observations 
is  further  examined  statistically  by  comparing  the  dif¬ 
ferences  between  the  observations  and  the  free-running 
model,  as  well  as  the  strong  and  the  weak  constraint 
analyses  for  both  the  assimilated  and  nonassimilated 
observations  at  all  times.  Elements  of  these  difference 
vectors  are  grouped  by  comparing  their  magnitudes  to 
the  observation  standard  deviations  in  the  following 
manner:  all  elements  with  an  absolute  value  smaller  than 
a  standard  deviation  are  binned  together,  and  so  are  all 
elements  whose  absolute  value  is  between  one  and  two 
standard  deviations,  and  so  on.  The  number  of  elements 
in  each  bin  is  then  converted  into  a  percentage  of  the 
number  of  assimilated  and  nonassimilated  observations, 
respectively.  The  results  are  plotted  as  a  cumulative  bar 
chart  in  Fig.  9  and  show  that  the  assimilated  solution  fits 
75%  and  93%  of  the  observations  to  within  one  and  two 
standard  deviations,  respectively,  for  the  weak  con¬ 
straints.  The  corresponding  numbers  are  65%  and  86% 
for  the  strong  constraints,  and  45%  and  66%  for  the  free 
run.  These  numbers  are  significantly  lower  for  the  non¬ 
assimilated  observations.  The  weak  constraint  solutions 
fit  64%  and  84%  of  the  nonassimilated  observations 
within  one  and  two  standard  deviations,  respectively, 
while  the  corresponding  numbers  for  the  strong  con¬ 
straints  are  60.5%  and  81%,  and  50%  and  71%  for  the 
free-running  model. 

5.  Conclusions 

Strong  and  weak  constraint  4DVAR  experiments  in 
Monterey  Bay  were  carried  out  using  the  observations 
collected  during  AOSN II  and  the  linearized  and  adjoint 
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Fig.  9.  Cumulative  bar  chart  showing  the  percentage  of  the  number  of  observations  that  are  matched  by  the  free- 
running  model  (black),  and  the  strong  constraints  (gray),  and  weak  constraints  (white)  as  a  function  of  the  number 
of  observation  standard  deviations,  for  the  (a)  assimilated  and  (b)  nonassimilated  observations. 


NCOM.  Starting  from  a  free-run  solution  that  com¬ 
pletely  misrepresented  both  the  data  and  the  dynamics 
of  the  region  during  the  selected  time  period,  the  as¬ 
similation  was  able  to  accurately  fit  the  assimilated  data. 
As  should  be  expected,  the  fit  to  the  assimilated  obser¬ 
vations  was  more  accurate  for  the  weak  than  the  strong 
constraints.  Also,  contrary  to  the  free  run,  the  upwelling 
and  relaxation  events  that  dominate  the  dynamics  of  the 
region  were  accurately  described  by  both  strong  and 
weak  constraint  analyses,  which  benefited  from  good 
observation  coverage  of  the  domain  and  a  robust  as¬ 
similation  system.  To  avoid  redundancy,  some  glider 
profiles  were  withheld  from  the  assimilation  and  used 
for  evaluation.  The  analysis  fit  the  withheld  observations 
accurately  in  the  first  half  of  the  assimilation  window, 
but  with  less  accuracy  than  the  assimilated  observations 
in  the  second  half,  which  were  composed  of  transitions 
from  upwelling  to  relaxation  and  back  to  upwelling.  This 
was  also  due  in  part  to  the  way  the  assimilated  obser¬ 
vations  were  selected  and  the  slow  to  moderate  flow  in 
the  model  dynamics. 

The  analysis  was  also  evaluated  against  independent 
observations  from  Ml.  The  location  was  chosen  not  only 
because  of  the  availability  of  observations,  but  also  be¬ 
cause  of  the  strong  correlation  between  the  recorded 
temperatures  and  the  observed  wind  stress  forcing.  Both 
the  strong  and  weak  constraint  assimilations  were  able 
to  accurately  reproduce  the  observed  temperatures. 
Also,  analysis  discrepancies  showed  that  the  strong 
constraint  assimilation  was  able  to  significantly,  but  not 


completely,  reduce  the  salinity  errors,  particularly  the 
peak  errors  around  14  August  and  19-21  August.  The 
weak  constraint  analysis  was  able  to  further  reduce  these 
salinity  errors. 

Quantitatively  and  qualitatively,  the  results  from  the 
experiments  show  that  the  assimilated  solutions  fit  75% 
and  93%  of  the  observations  to  within  one  and  two 
standard  deviations,  respectively,  for  the  weak  con¬ 
straints,  with  the  corresponding  numbers  being  65%  and 
86%  for  the  strong  constraints,  and  45%  and  66%  for  the 
free  run.  These  numbers  are  significantly  lower  for  the 
nonassimilated  observations.  The  weak  constraint  so¬ 
lutions  fit  64%  and  84%  of  the  nonassimilated  ob¬ 
servations  within  one  and  two  standard  deviations, 
respectively,  while  the  corresponding  numbers  for  the 
strong  constraints  are  60.5%  and  81%,  and  50%  and 
71%  for  the  free-running  model.  It  can  be  argued  that 
longer  correlation  scales  and  slightly  higher  model  er¬ 
rors,  especially  in  the  second  half  of  the  assimilation 
window,  could  have  led  to  a  better  fit  to  the  independent 
observations.  A  weak  constraints  experiment  with  lon¬ 
ger  correlation  scales  was  carried  out  here  and  yielded 
a  better  fit  to  the  nonassimilated  observations.  However, 
correlation  scales  and  model  errors  cannot  be  arbitrarily 
increased  and  the  investigation  of  their  optimal  values 
is  beyond  the  scope  of  this  study. 
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